home
***
CD-ROM
|
disk
|
FTP
|
other
***
search
/
ftp.cs.arizona.edu
/
ftp.cs.arizona.edu.tar
/
ftp.cs.arizona.edu
/
icon
/
newsgrp
/
group98a.txt
/
000011_icon-group-sender _Thu Jan 22 10:27:46 1998.msg
< prev
next >
Wrap
Internet Message Format
|
2000-09-20
|
3KB
Return-Path: <icon-group-sender>
Received: from kingfisher.CS.Arizona.EDU (kingfisher.CS.Arizona.EDU [192.12.69.239])
by baskerville.CS.Arizona.EDU (8.8.7/8.8.7) with SMTP id KAA03654
for <icon-group-addresses@baskerville.CS.Arizona.EDU>; Thu, 22 Jan 1998 10:27:45 -0700 (MST)
Received: by kingfisher.CS.Arizona.EDU (5.65v4.0/1.1.8.2/08Nov94-0446PM)
id AA00343; Thu, 22 Jan 1998 10:27:45 -0700
Date: Wed, 21 Jan 1998 18:56:42 -0600 (CST)
From: Ramon Pereda <rpereda@ringer.cs.utsa.edu>
X-Sender: rpereda@ringer
To: MJE <evans@gte.net>
Cc: icon-group@optima.CS.Arizona.EDU
Subject: Re: Shannon-theoretic Language Approximators
In-Reply-To: <6a596h$gt3$1@gte2.gte.net>
Message-Id: <Pine.GSO.3.95.980121184352.5128A-100000@ringer>
Mime-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Errors-To: icon-group-errors@optima.CS.Arizona.EDU
Status: RO
Content-Length: 1851
On Wed, 21 Jan 1998, MJE wrote:
> I am wondering whether anyone has written a random-text generator in the Icon
> language of the sort that is described in the book "An Introduction to
> Information Theory : Symbols, Signals and Noise" by John Robinson Pierce
> (paperback; @ US$7.16 from http://www.amazon.com).
Tell me a little more about the book and I'll consider buying it.
amazon.com does not have a table of contents. Icon would be ideal
for this sort of application. I'd be glad to get you started, if
I buy the book and the theory is not too thick. I'm very interested
in n-grams. Does the book talk any about n-grams? There is an
n-grams sample program in the Icon program library but it only
does n-grams for single letters. I'd like to do n-grams for
words and arbitrary items. If I remember correctly it was not
straight forward to modify the program to handle these extensions.
> One of Shannon's studies involved the generation of random words that
> correspond, in a statistical/probabilistic sense, to English. The text is
> meaningless, but because it corresponds to the statistics of English, it can
> serve as a basis for studying the transmission of English prose. In principle,
> the technique applies to any other language as well.
There is a an old book with a title like Icon programming for the
Humanities that touches on these issues. I would only recommend
it as a very basic introduction.
> MORE GENERALLY: I would be interested in any Icon implementations of language
> statistics. Examples: counting frequencies of characters in a block of text,
> counting word frequencies in a block of text, examining symmetries in poetry,
> computing estimated probabilities of particular sequences of characters.
Browse the Icon programming library at www.cs.arizon.edu. I'm sure
there is some stuff.
-ray